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METHOD FOR EXTRACTING FEATURE OF BINARY IMAGE 



TECHNICAL FIELP 
The present invention relates to a method for extracting 
feature quantities of image data that is used in an image 
processing apparatus etc. In particular, the invention relates 
to a binary image feature quantity extracting method capable of 
O extracting, properly and smoothly, an area, a circumferential 

yj length, end point coordinates, coordinates of the center of 

V, i 

b 5f gravity, a second moment, etc. of each image area by scanning 

tfi . 
Li 

binary image data once. 

Si . BACKGROUND ART 

Conventionally, various methods were proposed for a means 

a . 

r ~" for extracting desired feature quantities from binary image data 
obtained by binarizing an image signal received from an imaging 
device such as a CCD camera. 

For example, a method is known in which feature quantities 
such as an area, the center of gravity, and a principle axis angle 
are extracted in real time by preprocessing (binarizing) an image 
signal in the same time series as of a video signal, scanning 
the pixels of resulting binary data by a raster scanning method 
or the like, detecting an image from a XA 1" and *0" arrangement 
of the pixels, and performing various calculations such as 
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surface integral on the pixels belonging to a region of the image . 

However, in this extracting method, surface integral is 
performed by extracting (accessing) all pixels to extract 
feature quantities such as an area and hence this method includes 
a number of processing steps. As such, this method is not 
-suitable for high-speed processing. 

In view of the above, conventionally, a binary image 
feature quantity extracting apparatus was proposed having a 
binary image storing means for storing a binary image; an outline 
tracing means for obtaining, as a closed loop, position 
coordinates of outline pixels by tracing the outline of the binary 
image that is stored in the binary image storing means; and a 
feature quantity calculating means for extracting feature 
quantities relating to a figure that is enclosed by the closed 
loop by integrating, along the closed loop representing the 
outline, a monomial relating to the position coordinates of the 
outline pixels obtained by the outline tracing means. The 
outline tracing means extracts an outline of an object or the 
like that exists in image data and traces the outline- The 
feature quantity calculating means calculates a Oth moment, a 
first moment, etc. based on position coordinate data of the pixels 
that constitute the outline, and calculates an area based on the 
Oth moment and calculates the center of gravity of the image based 
on the Oth moment and the first moment. In this manner, feature 
quantities such as an area and the center of gravity are detected 



based on a small number of pixels, that is, pixel data that 
constitute an outline, while outline tracing (image detection) 
is performed. 

The above conventional binary image quantity extracting 
apparatus extracts an outline of an image that exists in image 
data and traces the outline, and performs calculations such as 
calculating several kinds of moments based on position 
coordinate data of the pixels that constitute the outline, 
calculating an area based on a Oth moment, and calculating the 
center of gravity of the image based on the Oth moment and the 
first moment . Although the data processing amount can be reduced, 
the calculation processing is still complex and there are certain 
limits in the facilitation and the speed increase of the data 
processing for extracting feature quantities . 

In general, the following feature quantities of image data 
are known . 

1. Area S 

This feature quantity can be represented by the total 
number of pixels of a subject image area. With this feature 
quantity, very small noise can be eliminated easily because it 
has small values. Fig, 8 shows the areas Si and S2 of image areas 
Al and A2, respectively. 

2. C i rcumf e rent ia J — length h 

This feature quantity can be represented by the number of 
end pixels of a subject image area (four-side adjacency) . Rather 



than used independently, its value is effective when used as a 
ratio to the area, that is, a' feature quantity representing the 
degree of roundness. Fig, 8 shows the circumferential lengths 
Ll and L2 of the image areas Al and A2, respectively. 

3. End point coordi nates (top end, bottom end, right end, left 
end) 

These feature quantities represent the coordinates of the 
top end, bottom end, right end, and left end of a subject image 
area. Their values provide position information of the subject 
image area and are useful for accessing the image data directly. 
Fig. 9 shows top coordinates (Xlu, Ylu) , left end coordinates 
(Xll, Yll), bottom coordinates (Xld, Yld) , and right end 
coordinates (Xlr, Ylr) of the image area Al and top coordinates 
(X2u, Y2u) , left end coordinates (X21, Y21) , bottom coordinates 
(X2d, Y2d) , and right end coordinates (X2r, Y2r) of the image 
area A2 . 

4. npntfir of gravity coordinates 

This feature quantity can be represented by center of 
gravity coordinates of a subject image area. These coordinate 
values are not necessarily located inside the subject image area. 
Their values can be calculated according to the following 
equation and serve to calculate the distance between image areas, 
for example. 
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Fig. 10 shows center of gravity coordinates (Xlg, Ylg) of- 
the image area Al and center of gravity coordinates (X2g, Y2g) 
of the image area A2- 
5. fig con d moment 

This feature quantity can be represented by the major axis 
length a, minor axis length b, and angle G of an ellipse having 
the same moment with calculation of a second moment of a subject 
image area. The values of these parameters can be calculated 
according to the following formulae: 
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M max = Max[S„cosie B +S xy sia2e t ,4.S yy sia 2 9 ft ];n=0, 1,2,3 
Mmin = Mim[S„cos2e B +S xy sifl2e a -hS yy 5in 2 e n ];n=0, 1,2,3 
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Fig. 11 shows a second moment (al, bl, 01) of the image 
area Al and a second moment (a2, b2 f 02) of the image area A2. 

After intensive studies and investigations f the inventor 
has found that an area, a circumferential length, end point 
coordinates, center of gravity coordinates, a second moment, etc. 
can be extracted properly and smoothly for each image area by 
the following method. That is, in extracting feature quantities 
such as an area, a circumferential length, end points, the center 
of gravity, and a moment of an image area by scanning, by a raster 
scanning method or the like, image data that is a binary to be 
displayed in one frame, setting is so made that when a pixel having 
a prescribed density is detected in scanning one line of the image 
data, the content of each of a pixel immediately preceding the 
detected pixel on the same line and a pixel that is on an 



immediately preceding line and right above the detected pixel 
is checked, and that an area number of the one image area is 
inherited when the detected pixel belongs to the same image area 
as one of the above pixels. The above processing is performed 
sequentially on the succeeding pixels to store resulting image 
data in a line buffer, whereby the scanning of the one line is 
finished. At this time, when consecutive pixels belong to 
respective image areas but have different area numbers after the 
scanning of the one line has completed, the line buffer in the 
reverse direction is scanned to modified the different area 
numbers to the same area number. Setting is so made that line 
scanning is performed over the entire one frame, that is, to its 
last line, in the same manner as performed above, whereby feature 
quantities are stored for each image area. 

Therefore, an object of the invention is to a binary image 
feature quantity extracting method capable of extracting, 
properly and easily, necessary feature quantities of each image 
area by scanning binary image data once. 

DISCLOSURE OF THE INVENTION 
To attain the above object, the present invention provides 
A method for extracting feature quantities of a binary image for 
extracting feature quantities such as an area, a circumferential 
length, end points, a center of gravity, and a moment of an image 
area by scanning, by a raster scanning method or the like, image 
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data that is a binary image to be displayed in one frame, 
characterized by comprising the steps of checking a content of 
each of a pixel immediately preceding the detected pixel on the 
same line and a pixel that is on an immediately preceding line 
and right above the detected pixel when a pixel having a 
prescribed density is detected in scanning one line of image data, 
inheriting an area number of the one image area when the detected 
pixel belongs to the same image area as one of the above pixels, 
performing the above processing sequentially on succeeding 
pixels to store resulting image data in a line buffer, scanning 
the line buffer in a reverse direction and modifying the different 
area numbers to the same area number when consecutive pixels 
belong to respective image areas but have different area numbers 
after the scanning of the one line has completed, and repeating 
the same line scanning to a last line of one frame to store feature 
quantities for each image area. 

The above method may further comprise the steps of checking 
a content of each of a pixel immediately preceding the detected 
pixel on the same line and a pixel that is on an immediately 
preceding line and right above the detected pixel when a pixel 
having a prescribed density is detected in scanning one line of 
the image data, and inheriting an area number of the image area 
of the pixel right above the detected pixel with priority given 
to it when the detected pixel belongs to image areas of both of 
the above pixels . 
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The binary image feature quantity extracting method 
according to the invention, may further comprise a step of 
performing scanning one line of the image data to provide N pixels 
(N being an integer greater than or equal to 1) that follows an 
image area having a prescribed area number that has just 
terminated as semi-image areas of an adjacent image area. 

The above method may further comprise a step of performing 
scanning one line of the image data to provide N pixels (N being 

O 

y;| an integer greater than or equal to 1) that follows an image area 

|»b having the same area number that has just terminated as semi-image 
U 

hp areas of an image area that is adjacent from right above when 

W • 

SJ the image area having a prescribed area number terminated at the 

□ pixel that is located right above on an immediately preceding 

£ii 

riJ line. 

P . 

□ The above method may further comprise a step of scanning 
|»t 

the line buffer in a reverse direction and modifying the different 
area numbers to the common area number when consecutive pixels 
belong to respective image areas and semi-image areas but have 
different area numbers after the scanning of the one line has 
completed. 



BRTF.F DESCR IPTION OF THE DRAWINGS 

Fig. 1 is an explanatory diagram showing a data structure 
of feature quantities of image data, on which a binary image 
feature quantity extracting method according to the present 
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invention is practiced, that is, a memory format to be used for 
storing feature quantities of image data; 

Fig. 2 is an image data explanatory diagram showing how 
an image area of image data is generated in the binary image 
feature quantity extracting method according to the invention; 

Figs- 3(a)-3{c) are image data explanatory diagrams 
showing different ways an image area of image data is inherited 
in the binary image feature quantity extracting method according 
to the invention; 

Figs. 4 (a) and 4(b) are image data explanatory diagrams 
showing how image areas of image data are combined with each other 
in the binary image feature quantity extracting. method according 
to the invention; 

Fig. 5 is an image data explanatory diagram showing how 
a connection image area of image data is generated in the binary 
image feature quantity extracting method according to the 
invention; 

Fig. 6 is an image data explanatory diagram showing how 
a connected image area of image data is inherited in the binary 
image feature quantity extracting method according to the 
invention; 

Figs. 7(a) and 7(b) are image data explanatory diagrams 
showing how connected image areas of image data are combined with 
each other in the binary image, feature quantity extracting method 
according to the invention; 
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Fig. 8 is an image data explanatory diagram showing areas 
and circumferential lengths of respective subject image areas 
of image data in a binary image feature quantity extracting 
method; 

Fig. 9 is an image data explanatory diagram showing end 
point coordinates of subject image areas of image data in a binary 
image feature quantity extracting method; 

Fig. 10 is an image data explanatory diagram showing center 
of gravity coordinates of subject image areas of image data in 
a binary image feature quantity extracting method; and 

Fig . 11 is an image data explanatory diagram showing second 
moments of respective subject image areas of image data in a 
binary image feature quantity extracting method. 

BEST EMBODIENT FOR CARRYING OUT THE INVENTION 
Next, the best embodiment for carrying out a binary image 
feature quantity extracting method according to the present 
invention will be described in detail with reference to the 
accompanying drawings. 

Fig. 1 shows a binary image feature quantity extracting 
method according to an embodiment of the invention. 
Specifically, Fig. 1 shows a data structure for each image area 
for which feature quantities should be extracted, that is, a 
memory format to be used for storing feature quantities of image 
data. In this embodiment, the feature quantities of a binary 



image are an area, a^ circumferential length, end point 
coordinates, center of gravity coordinates, and a second moment 
of each image area An. 

Therefore, for an image area An shown in Fig. 1, with an 
image area effectiveness flag as the head, feature quantities 
of image data are arranged in order of an area, a circumferential 
length, a top point x coordinate, a top point y coordinate, a 
bottom point x coordinate, a bottom point y coordinate, a left 
end point x coordinate, a left end point y coordinate, a right 
end point x coordinate, a right end point y coordinate, the sum 
of x's, the sum of y's, the sum of x*x's, the sum of y*y's, and 
the sum of x*y's. 

Next, a method of extracting feature quantities of a binary 
image will be described. 

1- Data Processi ng relat i ng t o featur e quantities 

When image data of one picture is line-scanned, if a black 
pixel (any one of an effective image area) exists at coordinates 
(Xj, Yj), for example, the. following writing processing is 
performed on a memory (line buffer) and data are stored there 
for feature quantit ies of the image data : 

(1) Increment the area of the image area to which the pixel 
belongs . 

(2) Increment the circumferential length if the pixel 
belongs to the boundary of the image area. 

(3) Perform replacement if the pixel is located at an end 



of the image area (end point coordinates) . 

(.4) Update the sum of x' s (used for calculation of center 
of gravity coordinates) . 

(5) Update the sum of y' s (used for calculation of center 
of gravity coordinates) . 

(6) Update the sum of x*x's (used for calculation of a 
second moment) . 

(7) Update the sum of y*y' s (used for calculation of a 
second moment) . 

(8) Update the sum of x*y' s (used for calculation of a 
second moment) . 

2. Generation of feature quantities 

In a scan of one line of image data, if a black pixel An 
is detected as mentioned above, as shown in Fig. 2 what image 
area the subject pixel An belongs to is determined by checking 
a pixel An.! that immediately precedes the pixel An on the same 
line and a pixel An+1 that is located on the immediately preceding 
line and right above the pixel An. If neither pixel has an image 
area, a new image area Al is generated. 

3 . Inheritance of feature quantities 

In a scan of one line of image data, as shown in Figs. 
3 (a ) -3 ( c) , the pixel An. x immediately preceding the subj ect pixel 
An and/or the pixel An+1 right above the subject pixel An is 

checkeci and what image area each piKel-belongs fc*© ic determined . 

If the pixel An. x immediately preceding the subject pixel An has 



an image area A2, the subject pixel An inherits the image area 
A2 at its side (see Fig- 3(a)). 

If the pixel An+1 right above the subject pixel An has an 
image area A2, the subject pixel An inherits the image area A2 
located right above (see Fig. 3(b)). 

If the pixel An. x immediately preceding the subject pixel 
An and the pixel An+1 right above the subject pixel An have image 
areas Al and A2, respectively, the subject pixel An inherits the 
image area A2 of the pixel An+1 right above the subject pixel 
An with priority given to it (upwardness priority; see Fig, 3(c)). 
4 ♦ r.nmhining nf fu ture quantities 

When a scan of one line of image data has finished after 
repetition of the above-described generation and inheritance of 
feature quantities, there may be a case that consecutive image 
areas have different area numbers as shown in Fig. 4 (a) . In this 
case, to combine the image areas, the line buffer is scanned in 
the reverse direction. Then, as shown in Fig. 4(b), all the 
pixels adjacent to each other are caused to belong to the same 
image area A2 and the image areas to be used for the data 
processing for feature quantities are combined with each other. 
Portions that have been emptied of data are initialized and are 
subjected to used in the next data processing. 

By performing the generation, inheritance, and combining 
of feature quantities for each one-line scan of the image data 
in the above-described manner to the last line, individual 
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feature quantities can be stored in the memory (line buffer) 
according to the data structure (memory format) shown in Fig. 
1 on an image area basis. 
5. Connection of feature guantiHp.c; 

It is effective to regard,, as belonging to the same image 
area, image areas that have been obtained as a result of the above 
processing of generation, inheritance, and combining of feature 
quantities and that do not satisfy the conditions of combining 
and distant from each other by several pixels. That is, this 
is necessary for image data of "dot marking," xx blurring, " or the 
like . 

Specifically, two image areas that are distance from each 
other by N pixels, say, two pixels (N « 2) , are connected to each 
other to form the same area with the two adjacent pixels regarded 
as belong to respective semi-image areas. This connection 
technique is used in the same manner as the above processing of 
generation, inheritance, and combining of feature quantities. 

(a) Generation of connected image area 

As shown in Fig. 5, after generation of an image area A2 . 0 
at a subject pixel An, semi-image areas A2 . 1 and A2.2 (N = 2) 
are generated at th<=» two f ol ^ own ng pi xrI s An Tl and An +2 and Hi stance 
information is stored in the line buffer together with the 
information of the image area A2 . 0 . 

(b) Inheritance of conne cted image area 

Similarly, if the pixel An+1 right above a subject pixel 
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An has an image area A2.0, inheritance is made with semi-image 
areas A2 . 1 and A2 . 2 generated at two pixels adj acent to each other, 
that is, the subject pixel An and the immediately following pixel 
An +1 , respectively. 

(c) Combining of connected image areas 

If consecutive image areas have different area numbers as 
shown in Fig. 7(a), the line buffer is scanned in the reverse 
direction and adjacent pixels are caused to belong to the same 
area (or its semi-image areas) as shown in Fig. 7(b). 

Therefore, the above-described binary image feature 
quantity extracting method according to the invention makes it 
possible to extract, properly and smoothly, feature quantities 
that are an area, a circumferential length, end point coordinates, 
center of gravity coordinates, and a second moment of each image 
area based on data relating to feature quantities that have been 
extracted for the image area. 

Although the best embodiment for carrying out the 
embodiment has been described above, the invention is not 
limited to the above embodiment and various design 
modifications are possible without departing from the spirit 
and scope of the invention. 



INDUSTRIAL APPLICABILITY 
The invention provides a method for extracting feature 
quantities of a binary image for extracting feature quantities 
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such as an area, a circumferential length, end points, a center 
of gravity, and a moment of an image area by scanning, by a raster 
scanning method' or the like, image data that is a binary image 
to be displayed in one frame, characterized by comprising the 
steps of checking a content of each of a pixel immediately 
preceding the detected pixel on the same line and a pixel that 
is on an immediately preceding line and right above the detected 
pixel when a pixel having a prescribed density is detected in 
scanning one line of image data, inheriting an area number of 
the one image area when the detected pixel belongs to the same 
image area as one of the above pixels, performing the above 
processing sequentially on succeeding pixels to store resulting 
image data in a line buffer, scanning the line buffer in a reverse 
direction and modifying the different area numbers to the same 
area number when consecutive pixels belong to respective image 
areas but have different area numbers after the scanning of the 
one line has completed, and repeating the same line scanning to 
a last line of one frame to store feature quantities for each 
image area. In this manner, an area, a circumferential length, 
end point coordinates, center of gravity coordinates, a second 
moment, etc. can be extracted properly and smoothly for each image 
area by scanning binary image data once. 



